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from noisy irregular samples 
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Abstract 

This paper addresses the detection of a stochastic process in noise from irregular samples. We consider 
two hypotheses. The noise only hypothesis amounts to model the observations as a sample of a i.i.d. 
Gaussian random variables (noise only). The signal plus noise hypothesis models the observations as 
the samples of a continuous time stationary Gaussian process (the signal) taken at known but random 
time-instants corrupted with an additive noise. Two binary tests are considered, depending on which 
assumptions is retained as the null hypothesis. Assuming that the signal is a linear combination of the 
solution of a multidimensional stochastic differential equation (SDE), it is shown that the minimum Type 
II error probability decreases exponentially in the number of samples when the False Alarm probability 
is fixed. This behavior is described by error exponents that are completely characterized. It turns out that 
they are related with the asymptotic behavior of the Kalman Filter in random stationary environment, 
which is studied in this paper Finally, numerical illustrations of our claims are provided in the context 
of sensor networks. 
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I. Introduction 

The detection of stochastic processes in noise has received a great deal of attention in the past decades, 
see for instance the tutorial paper [1] and the references therein. More recently, in the context of sensor 
networks, there has been a rising interest in the analysis of detection performance when the stochastic 
process is sampled irregularly. An interesting approach in this direction has been initiated in [2] using 
error exponents for assessing the performance of the optimal detection procedure. In this paper, we 
follow this approach in the following general setting. Given two integers p and q, and A a positive stable 
square matrix, we consider the g-dimensional stochastic process defined as the stationary solution of the 
stochastic differential equation (SDE) 

dX{t) = -AX{t)At + BdW{t), t>0 (1) 

where {W{t), f > 0) is a p-dimensional Brownian motion and where B is, n qy.p matrix. The SDE ([T]) is 
widely used to describe continuous time signals (see [3], [4] and the references therein). We are interested 
in the detection of the signal {X{t), t > 0) from a finite sample with missing data or irregular sample 
spacing. Let C be a d x g matrix, {Tn,n > 1) be a renewal sampling process and {Vn,n > 1) be a 
sequence of i.i.d. Gaussian vectors with zero mean and identity covariance matrix. We further assume 
that {X{t), t > 0), {Vn, n > I) and (T„, n > 1) are independent and that A, B and C are known. Based 
on the observed samples Yi-^n = (Yi, . . . , Yat) and Ti-n = {Ti, ■ ■ ■ , T/v), our goal is to decide whether 
for n = 1, . . . , A^, y„ = Fri or y„ = CX{Tn) + Vn- The first situation will be referred to as the noise 
hypothesis and the second as the signal plus noise hypothesis. 

The renewal hypothesis on (T„, n > 1) means that T„ = Y^^=i^k where the {Ik,k > 1) are 
nonnegative i.i.d. random variables called holding times with common distribution denoted by r. This is 
a standard model for irregular sampling, see [2], [5], [6]. The most usual examples are: 

• The Poisson point process. In this case, the {Ik, k > 1) are i.i.d. with exponential distribution 
r(dx) = A exp(— Ax) dx. This model has been considered in [2], [5], [6] to model the situation 
where the signal is measured in time by N identical asynchronous sensors. 

• The Bernoulli process. This is the discrete time counterpart of the Poisson process. In this case, the 
(Ik, k > 1) are i.i.d. and have geometric distribution up to a multiplicative time constant S > 0, i.e. 
T{{Sk}) = p{l — p)^^^. In practice, this model corresponds to a regular sampling with period S 
for which observations are missing at random, with failure probability 1 — p. The regular sampling 
process corresponds to p = 1. 
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Two binary tests are considered in this work: either HO is the noise hypothesis and HI is the signal 
plus noise hypothesis, or the opposite. Constraining the False Alarm probability (probability for deciding 
H1 under HO) to lie beneath an e € (0, 1), it is well known that the minimum Type II error probability 
is attained by the Neyman-Pearson test. It will be shown in this paper that this minimum Type II error 
probability /3N{e) satisfies j3N{e) = exp(— A^(^ + o(l))) as ^ oo, where the error exponent ^ does not 
depend on e. The error exponent ^ is an indicator of the performance of the detection test. Its value will 
be shown to depend on the distribution of signal (given by A, B and C) and on the distribution of the 
sampling process (given by r). An important goal in sensor network design is to optimize the sampling 
process. Characterizing the error exponents offers useful guidelines in this direction. For instance, [2], 
[7]-[10] provide useful insights on such concrete problems as the choice of the optimum mean sensor 
spacing possibly subject to a cost or a power constraint. Other application examples are considered in 
[11], [12]. In these contributions, error exponents are used to propose optimum routing strategies for 
conveying the sensors data to the fusion center. 

In the context of Neyman-Pearson detection, these error exponents are given by the limits of the 
likelihood ratios, provided that these limits exist. Let Zi-n = (-^i, • • • > Z^) be a sequence of N observed 
random vectors. Assume a binary test is performed on this sequence, and assume that under hypothesis 
HO, the distribution of Zi-i\] has the density /o,Ar, while under HI , this distribution has the density fi^N- 
Fix e G (0, 1) and let (3^(6) be the minimum over all tests of the Type II error probability when the 
False Alarm probability a is constrained to satisfy a < e. Let 

be the normalized Log Likelihood Ratio (LLR) associated with the received Zi;N- Then we have the 
following theorem (see for instance [13] for a proof): 

Theorem 1 Assume there is a real number ^ such that the random variable Cn{Zi-n) satisfies 

Cn[Zi-n{(jj)) > ^ in probability under HO. (2) 

Then for every e € (0, 1), 

In the case where the Zi are i.i.d. under both hypotheses, the analogue of Theorem [T] appeared in [14] 
and is known as Stein's lemma. The generalization to Theorem [T] can be found in [13], [15]. In our case, 
the observed process is Zi-n = {Zi, . . . , Zn) with Zn = (y„,T„), in other words, the measurements 
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consist in the sampled received signal and the sampling moments. Let us consider that Yi-n = ^iiA^ 
under HO and Yi-n = {CX{Tn) + Vn)i<n<N under H1. Recall that the probability distribution of Ti-n 
does not depend on the hypothesis to be tested. In these conditions, the LLR is given by 



where fo^N{-\Ti;N) and /i,Ar(. j Ti:7v) are the densities of Yi-n conditionally to Ti-n under HO and 
HI respectively. It is clear that /o,Af(- \ Ti-n) = A/'(0, 1). Being solution of the SDE ([T]), the process 
{X{t), t > 0) is a Gaussian process. In consequence, /i,Ar(. | T'i:jv) = M{0, R{Ti:n)) where matrix 
R{Ti:j\^) is a covariance matrix that depends on Ti-]\j. In the light of Theorem [T] we need to establish 
the convergence in probability of the Right Hand Side (RHS) of Eq. ^ towards a constant ^, and to 
characterize this constant, under the assumption Yi-^r = Vi-]\f. Alternatively, if we consider that HO is 
the Signal plus Noise hypothesis Yi-n = {CX{T„) + Vn)i<n<N, then we study the convergence of —Cn 
under this assumption. 

Theorem [J has been used for detection performance analysis in [2], [7], [16], [17]. In the closely related 
Bayesian framework, error exponents have been obtained in [8]-[10], [18]. The closest contributions to 
this paper are [2], [7], [17] which consider different covariance structure for the process and different 
sensors locations models. In [7], Sung et.al. consider the scalar version of the SDE ([D and a regular 
sampling. In [17], the authors essentially generalize the results of [7] to situations where the sensor 
locations follow some deterministic periodic patterns. In [2], the sampling process (sensor locations) is 
a renewal process as in our paper, and the detector discriminates among two scalar diffusion processes 
described by Eq. Moreover, the observations are noiseless. Here, due to the presence of additive 
noise, our technique for establishing the existence of the error exponents and for characterizing them 
differ substantially from [2]. We establish the convergence of the LLR Cn{Zn) by studying the stability 
(ergodicity) of the Kalman filter, using Markov chains techniques. 

The paper is organized as follows. In Section |lll the main assumptions and notations are introduced and 
the main results of the paper are stated. Proofs of these results are presented in Section |lll] A discussion 
of the main results as well as some particular cases are presented in Section JV] Section |V] is devoted to 
numerical illustrations. The proofs in Section |lll] rely heavily on a theorem for Markov chains stability 
shown in appendix |B] The other appendices contain technical results needed in the proofs. 




(3) 
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II. The Error Exponents 
We consider the following hypothesis test that we shall call the "HO-Noise" test: 

m:Yn = Vn forn = l,...,iV 

(4) 

HI : y„ = CX{Tn) + Vn forn = 1, . . . , iV 
where C is the d x g observation matrix and where {Vn) is an i.i.d. d-dimensional process with Vi ~ 
AA(0, 1^), where 1^ denotes the d x d identity matrix. The assumptions are summarized below: 

Assumption 1 The following assertions hold. 

(i) The process {X{t))t>o i^ ci stationary solution of the stochastic differential equation ([T]) where 
iyV{t))t>Q is a p-dimensional Brownian motion. 

(ii) Tn = Yli -^k ^ renewal process, that is, (/«)«>! i^ ci sequence of i.i.d. non-negative r.v.'s with 
distribution r and t({0}) < 1. 

(Hi) iyn) is a sequence of i.i.d. r.v.'s with Vi ^ A/'(0, 1^). 

(iv) The processes {X{t))t>o, iTn)n>i and {yn)n>i are independent. 

In order to be able to apply Theorem [1] we now develop the expression of the LLR given by ([3]). To 
that end, we derive the expressions of the likelihood functions /o,Af(5^i:Af | Ti-n) and fi^NiXi-.N \ Ti-.n)- 
The density /o,Af(. | Ti-^n) is simply the density Af{0, iNd) of (Vi, . . . , Vn), therefore 

We now develop /i,Ar(. | Ti^tv) by mimicking the approach developed in [19] and in [7]. Solving Eq. ([T]) 
between T„ and Tn+i, the process = (X(r„))„>i satisfies the recursion 

= e-^"+^^X„ + [/„+!, n G N (6) 

Let Q{x) be the g x g symmetric nonnegative matrix defined by 

Q{x) = [ e-"^SSTe-"^^d7/ . (7) 
Jo 

As A is positive stable, the covariance matrix Q{oo) exists (by Lemma |3]l and is the unique solution of 
the so called Lyapunov's equation QA^ + AQ = BB^ [20, Chap. 2]. 

Given the sequence (/„), the conditional distribution of the process is characterized by this 

recursion equation and by the conditional distribution of the sequence (Xq, Un), namely it is a sequence 
of independent r.v.'s, Xq ~ A/'(0, (^(oo)) and Un ~ A/'(0, Qn) where Qn = Q{In) is the covariance 
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matrix defined by ([7]), see [3, Chap. 5]. 
Now we write 

N 

■.n-l,Ti:N) (8) 

n=l 

where /i,n,7v(- \ yi:n-i,Ti-N) is the density of Yn conditionally to {Yi:n~i,Ti-j\[). In view of Eq. 
Yn = CXn + Vn and the assumptions on {Vn), these conditional densities are Gaussian, in other words 

h,n,N {Yn I yi:n-l, Ti:^) = ^^^^^^^^yj^ ^Xp [-\{Yn " Ynf K\Yn - (9) 



where Yn = E [y„ | Ti^at] and A„ = Cov [Yn — Yn\Ti.Nj are respectively the conditional 

expectation of the current observation y„ given the past observations and the so-called innovation 
covariance matrix under H1. From Equations dUl and the LLR Cn writes 

1 1 

Cn{Yi:N-, Ti-n) = log fo,N{Yl:N \ Ti:n) - log /l,Ar(yi:Ar | Ti-n) 

1 ^ 1 ^ ^ 1 ^ 

= ^ E log det A„ + — - YnfA-\Yn -Yn)-^Y1 ^nYn (10) 

n=l n=l n=l 

As is described under H1 by the state equations 

HI : for n = 1, . . . , A*, (11) 

it is well known that Yn and A„ can be computed using the Kalman filter recursive equations. Define 
the q X 1 vector Xn and the q x q matrix P„ as 



Xn = E[Xn\Yi.,n-i,Ti.,N] and Pn = Coy (Xn-Xn\Ti., J 
The Kalman recursions which provide these quantities are [21, Prop. 12.2.2]: 

Xn+i = e-^"+^^ (l, - PnC^ {CPnC^ + Id)"' c) A„ + e-^"+^^P„CT (WC^ + 1^)"' Yn (12) 
= e-^"+^^ (l, - P„CT {CPnC^ + U) P„e-^"+^^" + . (13) 



The recursion is started with the initial conditions Xi = and Pi = Q{(X)). With these quantities at 
hand, Yn and A„ are given by 

Yn = CXn and A„ = CPnC^ + U . (14) 

With these expressions at hand, our purpose is to study the asymptotic behavior of given by Eq. (ITOl ) 
assuming that that (Yn) is i.i.d. with Yi ~ A/'(0, 1^) (HO-Noise test). 
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q-l 

In our analysis, we shall require Model ([T|) to be controllable, i.e., {A, B) satisfies A^BB^ > 0. 

£=0 

Recall that {A, B) is controllable if and only if the matrix Q{x) defined by Equation ^ is nonsingular 
for any x > (see [22, Chap. 6] for a proof). 

The Kalman equations ([T2l)-(fT3]) can be written as a random iteration, 

where Wn = = (/„+i,y„) and, for any r/ = {I,Y) G M+ x M'^ and w = (x,p) G 

X Vq where Vq is the cone of g x g symmetric nonnegative matrices, 

e-^^ (l, - pCT (CpCT + 1,)-^ C) X + e-'\C^ (CpC^ + l,)"^ Y 
e-'^ [iq - pCT {CpC^ + 1,)-^ C) pe-^^" + Q{I) . 

Under HO, since {rjn) is a sequence of i.i.d. random variables, {Wn)n>o is a Markov chain starting 
at Wq = {0,Q{oo)). Observe also that since the second component of , denoted by -F/(p) in the 
following, does not depend on x, {Pn)n>i also is a Markov chain starting at Pi = Q{oo) and since it 
neither depends on Y, this is true under H1 as well. Let [0, (5(oo)] denotes the subset of all matrices 
p £ Vq such that p < Q{oo). It is easy to see that, for any / > 0, [0,Q{oo)] is a stable set for Fj. 
Indeed, suppose that p G [0,Q(oo)], then 

Flip) = e-'^ (l, - PC^ {CpC^ + Id)"' C) pe-'^^ + Q{I) 
<e-^V-'^" + Q(/) 
< e-^^Q(oo)e-^^" + Q{I) = Q{oo) , 

by definition of Q in Hence, in the following, we consider (Wn) and (P„) as chains valued in 
x [0, Q{c<d)] and [0, Q{oo)], respectively. We will denote by 11 and IT the transition kernels associated 
to the chains (Wn) (under HO) and [Pn), respectively, that is, for test functions / and / defined on 

X [0,Q(cx))] and [0,Q(oo)] , 

n/(w) =E[/(F^(w))], wGM5x[0,Q(cx))] 
n/(p) = E[/(F,(P))], P G [0, Q(oo)] , 
where rj = {I, Y) is distributed according to the distribution T(E>Af{0, Id)- We now state our main results. 

Proposition 1 Suppose that Assumption\l\holds with a state realization {A,B,C) such that A is positive 
stable and {A, B) is controllable. Then the transition kernel H has a unique invariant distribution /i. 
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The notation |w| in the following proposition denotes some norm on M''+'?\ 

Proposition 2 Suppose that Assumption\J\holds with a state realization (A, B, C) such that A is positive 
stable and {A, B) is controllable. Then the transition kernel 11 has a unique invariant distribution u. 
This distribution satisfies J |w|''dz^(w) < oo for any r > 0. Moreover, the distribution fi defined in 
Proposition\J}is the marginal distribution /i(-) = i^(R'' x •). 

The main result for the HO-Noise test in the vector case can now be stated. 

Theorem 2 Suppose that Assumption\J\ holds with a state realization {A,B,C) such that A is positive 
stable and (A, B) is controllable. Consider the hypothesis test Let e € (0, 1). For a given N, let 
/5Ar(e) be the minimum of the Type II error probabilities over all tests for which the false alarm probability 
a satisfies a < e. Then, as N oo, N^^ log/37v(e) iHO:Noise, where 

iHO:Noise = \j {log det (CpC^ + 1^) + tr [c(xxT - p)C^ (CpC'T + Id) } di/(x, p) G (0, cxd) , 

(16) 

where the distribution u is defined in Proposition |2] 

If we interchange the roles of HO and HI in (|4l) (call this test the "HO-Signal" test), we obtain the 
following result: 

Theorem 3 Assume the setting of Theorem |2] with the roles of HO and HI interchanged. Then, as 

N ^ oo, N^^ log/3Ar(e) Cm.signai, where 

iHO:Signai = \ (tr {CQ{^)C'^) - j log det (CpC^ + Id) d^(p)^ G (0, oo) , (17) 
where the distribution fj, is defined in Proposition\J} 

Note that the problem of existence and uniqueness of jj, as well as a study of its properties in the case 
where the sampling process is a Bernoulli process have been recently undertaken in [23]. 

III. Proofs 

In this section, we prove Propositions [T] and |2j and Theorems |2] and [3] All these results follow from 
an analysis of the Markov chains induced by the transition kernels 11 and 11, or, equivalently, by the 
random iteration functions and Fj defined in (fTSl ). We start with a series of preliminary results for 
which we will need the following notation and assumptions. Assume that (??,?7n)n>i is a sequence of 
i.i.d. r.v.'s distributed according to the distribution r(g)A/'(0, 1^), where r is a distribution on M+ such that 
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t({0}) < 1. We denote 77 = {I,V) and r/„ = {In,Vn) for all n > 1 in accordance with Assumption [T] 
For any x € M'' and p € [0, Q{oo)\, we define two Markov chains induced by 11 and IT and starting at 
w = (x, p) and p, respectively 

= w and = p 

< 

Zr = F,,(Zr_i) and Zl = Fi,{Zl_,), k>l. 

V 

As noticed earlier, corresponds to the second component of Z'^ for each k and is valued in [0, Q{oo)]. 
Finally we introduce the following notation for the Kalman gain matrix 

G(p) =pCT(lrf + CpCT)-i , 

and the short-hand notation for G{Z^) (the Kalman gain matrix at time k): 

Gl = ZlC^(ld + CZlC^)-\ k>0, (18) 

As for the Kalman transition matrix, we set 

e(/,p)=e-^^(l,-G(p)C), 

and the short-hand notation for G(/fc,G^) (the Kalman transition matrix at time k): 

QP = e-'-^il, - Gl_^C), n > 1 . (19) 

Using this notation and = Q{Ik), the Kalman covariance update equation Z^ = Fjj^{Z^_-^) can be 
expressed for all /c > 1 as 

= ©r^Lier + - GUC)Z^_,C^Gl^,e-^^^^ + Q, (20) 

= QlZ^k-iQl^ + Qk, (21) 

where 

Qk = e-'^^GP_,GPTie-^^^" + Qk, k>l. ill) 

Finally we denote a product of successive Kalman transition matrices by 

0?J,m = 05?0Li---0^+i, 0<m<n. (23) 

Note that On,n-i = ©n- If rn, = n, we will use the convention Qn,n = l<j- 

We shall prove a moment contraction result on the sequence (0^o)»^>i (Lemma [2]) and from this 
result and some algebra (mainly contained in Proposition O deduce a moment contraction condition on 
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the random iteration functions and Fi. Then a general result on Markov chains (Theorem |4] in the 
appendix), tailored for this kind of conditions, will allow to conclude the proofs of our main results. 

We first derive a deterministic bound for Bn,m based on (|2TI) . which relies on a Lyapunov function 
argument similar to that in [24, Theorem 2.4] and [25, Sec. 4]. In the following, we denote by \x\ the 
Euclidean norm of the vector x, \m\n{H) and Aniax(-f^) the minimum and maximum eigenvalue of the 
matrix H and by \\H\\ its operator norm, \\H\\ = Ainax(^^^)^^^- 

Lemma 1 For any < m < n, we have 

\\&lJ\'<\\zn\\iz^)-'\\ n fi-nii^l ' ^'^^ 

fc=m+l \ II fc II / 

Proof: Obviously Qf. > Qk, hence Amin(Qfc) ^ ^mm{Qk)- Now, for a given x„ € W^, define the 
backward recursion Xk = Q^^^x^+i for k decreasing from n — l down to m, and set Vf, = xJZ^Xk for 
k = m, . . . ,n. We have 

by (EB, and moreover, x^Q„x„ > \xn\^XminiQn) > \xn\^>^miniQn) > KiAmm(Qn)/||-^n II ■ Hence, 
K-1 < K (l - Amin(<5n)/||^n ll). Iterating, we obtain 

Vm<vn n fi-nT#^l ^i^-i'ii^'ii n fi-^w^l • (25) 

k=m+l V II II / k=m+l \ II II / 

On the other hand, by (l23]l, Vm = x^Z^Xm = x^9^,m^m6n,m2;„, hence Amin(^m) xJ^Q^^m&nJnXn < 
Vrn- This, with Inequality ( |25l ). implies (l24l ). ■ 

Lemma 2 Assume that the matrix A is positive stable and that the pair (A, B) is controllable. For any 
r > 0, there exist K > Q and p € (0, 1) such that 



E 



2r 

II ^n.m II 

pe[o,(9{oo)] 



sup 



<Kp'^-'^, 0<m<n. 



Proof: Recall that for p € [0,Q{oo)], we have G [0,Q(oo)] for all A: > 1. Note that G is 
continuous and, by Lemma [H sup;, lle"^*""^]! < oo. Hence, 

Z* = sup sup||Z^|| < oo and Q* = sup sup||0^|| < oo . 

pe[0,Q(oo)] fc>l pe[0,Q(oo)] fc>i 

Let < m < n. Let e > that we will chose arbitrarily small later. Denote T = mi{k > m, If. > e}. 
Then we have, by (|2TI ) and (l22l ). 

Amm(^^) > Amm(Qr) > Amm(Q(e)) > , (26) 
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by Lemma |4l We now write 



n—l 



k=m 
n-1 



k=m 

For any k < n, applying Lemma [T] and the bound (l26l ). we have, on the event T = k, 

j=T+l ^ ^ / 

Observe that T — m + 1 is a geometric r.v. with parameter = T([e, oo)) and that {QT+i)i>i is i.i.d., 
independent of T, and follows the same distribution as Q{I). Moreover, by Lemma |4l XmmiQil)) > 
for / > 0, and since, t({0}) < 1, we have 7 = E[(l - Amm(Q(/))/^*)^1 < 1- Thus we get 



E 



sup IIQ^.mf"" 

pe[0,Q(oo)] 



n-1 

\k—m 



k=m kyn 

where we chose e > small enough so that - Te) < 1 and set p = 7 V {(G*)^'"(l - r^)} < 1. 

This gives the result for any p € (p, 1) by conveniently choosing K. ■ 

Proposition 3 Wfe have, for a// p, q G "Pg, 

^^-^;? = 0^,o(P-q)0nJ' (27) 
Moreover, there exists a constant C > such that, for all p, q G [0, Q{oo)], 

||GP-G^||<C||p-q||||ePolll|G^,olN ri>l, (28) 

n 

lieP ^- 0:^,^11 < Clip- q|| E I10n,,lll|0i-i,™lll|0i-i,illl|0i-i,ill ' 0<m<n. (29) 

jr=m+l 

Proof: Let us prove (|27] ). By induction, it is sufficient to show that 

F,(p)-F,(q) = e(I,p)(p-q)eT(/,q) . (30) 

By continuity of Fj and •), we may assume that p and q are invertible. In this case, the matrix 
inversion lemma gives that 

(p - pC^iCpC + ld)-^Cp) = (p-1 + C^C)-^ , (31) 
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and the same is true with q replacing p. Hence 

F,(p) - F/(q) = e-^^ [(p'^ + C-'C)-' - (q'^ + C^C)-'] e"^^^ 

= e-^^(p-^ + C^C)-'^-' [p - q] q-^(q-i + C^CT^e-^^^ . 

Using again ( [311 ) and the definition of 6, we get ( [30l ). which achieves the proof of ( [27l ). 

We now prove (|28] ). Observe that G is continuously differentiable on the compact set [0, Q{oo)]. Hence 
||G(p) -G(q)|| < C||p-q|| for some constant C > 0. Thus, since = G{Z^), the bound (HH) follows 
from (|27]|. 

Finally we prove (l29l) . We have, for all < m < n (recall the convention Qn,n = Qm,m = Iq), 



^n,m ^n,m / j n,j\ j j ) j — l,m ' 

j=m+l 

On the other hand, - 9^ = e-^^'^{Gj_^ - G^_^)C, and ^ thus follows from (EUl. ■ 
We can now prove Propositions [D Theorem [3l Proposition |2] and Theorem |2l mainly as consequences 
of Theorem |4l 

Proof of Proposition [7] anJ Theorem \3\ 

Using (|27] ) in Proposition [3l Lemma |2] and the Holder inequality, we obtain that, for any q > there 
exists C > and a G (0, 1) such that 



E 



IZP - Z'll 



<C7a", p,q G [0,Q(oo)], n > 1 . (32) 



This corresponds to Condition (i) in Theorem ID Condition (ii) is trivially satisfied for any s and r = 1 
since here X = [0,Q{oo)] is a compact state space. Hence Proposition [T] follows from Theorem |4la). 

Next we prove Theorem|3] By Theorem[T] it is sufficient to prove that —Cj\[{Yi-j\[,Ti:n) as expressed 
in dTOl ) converges to ^HO:Signai in probability when Yn = CXn + Vn for all n > 1. Since, for all n > 1, 
Pn = Z^^^ and log det A„ is a Lipschitz function of P„, we have by Theorem Ub) that 

1 ^ r 

- V log det A„ / log det(CpC7T + 1^) ^(dp) . (33) 

n=l 

This is true independently of the definition of and hence will also be used in the proof of Theorem |2] 
In contrast the specific definition of here implies that Yn = IE[1^ | Yi-n~i,Ti:i\i] and A„ = 
Cov(y„ — Yn)- Hence {{Yn — y„)^A,^^(y„ — Yn))n>i is a sequence of i.i.d. M{0, 1) r.v.'s, which yields 

1 ^ 

- Y^iYn - YnfA~\Yn - Yn) d . 

n=l 



DRAFT 



SUBMITTED TO IEEE TRANS. INFORMATION THEORY 



13 



On the other hand, in (fTOl) this limit cancels with 

1 ^ 

n=l 

which appears in the last term of ([TOl) when developing Y^Y^ = V^Vn + X'^C^CX^ + 2XjC'^14- 
Hence it only remains to show that 

1 ^ 

- V X^C^CXn tr(CQ((X))CT) , (35) 

n=l 
1 ^ 

-E^Jcr-K^O. (36) 

n=l 

To this end, recall that {Xn) is a Markov chain, whose distribution is defined by the recurrence equation ^ 
and the initial condition Xq ~ M{0,Q{oo)). We shall establish the ergodicity of this Markov chain by 
again applying Theorem ID For any x £ M*^, we denote by (X^) the Markov chain defined with the same 
recurrence equation but with initial condition Xq = x. Then we have, by iterating, 

n 

= e" ^?=i x + Y^ e" ^^='=+1 Uk,n>l. 
k=l 

with the convention Yl]=n+i ~ Recall that, given In, the conditional distribution of [7„ is Af{0, Qn) 
and Qn = Q{In) £ [0,Q{oo)]. Hence E[|C/„|'* [ /„] is a bounded r.v. for any s > 0. By Lemma |3j we 
have E[||e~^^='=+i^^^||*] < (E[e~"'*^i])"~'^ for same K,s > 0. Hence, we obtain, for any s > 0, for 
some constants C > and a € (0, 1), for all x, y € M'', 

E[Kr]<c(i + ixn. 

These are conditions (i) and (ii) of Theorem |4] with r = p = 1. Moreover, (Xn) has a constant marginal 
distribution, namely 7V(0, (5(oo)), so that the invariant distribution jj, of Theorem |4t a) is necessary 
fi = Af{0,Q{(yo)). Now, applying Theorem Ub) and Theorem life), we get (1351 ) and (l36l ). with a = 2 
and a = 1 respectively. 

To achieve the proof of Theorem[3l it remains to prove that ^HOiSignai > 0. This results from log det(CpC^+ 
Id) < tr(Cg(oo)CT) for every p G [0,g(oo)]. 

Proof of Proposition |2] and Theorem |2] 

Let w = (x, p) G M"? X [0, Q(oo)]. We denote the first component of by so that = {Z^ Z^). 
Using the notation introduced above, we have, for all k > I, ZJ = elZJ_^ + e~^''^Gl_^Yk-i, and, by 



DRAFT 



SUBMITTED TO IEEE TRANS. INFORMATION THEORY 



14 



iterating, 

n 

fc=i 

By continuity of G, it is bounded on the compact set [0, (5(oo)], hence supp „ ||G^|| < oo. Also by 
Lemma [3l sup^ Ije"^*^"^!! < oo. Applying these bounds, Lemma |2l the Minkowski Inequality and the 
Holder Inequality in the previous display, we obtain, for any s > and some constant C > 0, 

E[|Z^|^] <C(l + |x|^), w= (x,p) gM" X [0,Q(oo)], n> 1 . (37) 

Since the second component of stays in the compact set [0,(5(oo)]> this implies Condition (i) in 
Theorem |4] with r = 1 for the complete chain (Z^)fc>o. 
Let now v = (y,q) G M'? x [0, Q(cx))]. We have 

n n 
k=l k=l 

Note that, using Lemma |2j the bounds (1281 ) and ( [29l ) in Proposition [3l the Holder Inequality and the 
Minkowski Inequality, we obtain, for any r > and some constants C > 0, and p G (0,1) not depending 
on p, q, 

IE[|GP - G^in < Cp" and E[\ei^ - eU'] < C p\ 0<m<n. 

Using these bounds. Lemma [2] and the previous two displays, we thus obtain, for any g > and some 
constants C > 0, and a G (0, 1) not depending on w, v, 

E [\Z^ - Zll"] < Ga^ (1 + Ixl"? + lyl"?), n > 1 . 

This, with (l32l ). implies Condition (i) in Theorem |4] with p = 1 for the chain {Z^)k>o. Hence Theorem|4ta) 
applies, which yields the conclusions of Proposition |2l 

We now prove Theorem |2j that is, by Theorem [T] we prove that CnIYi-.NjTi-n) converges to ^HO:Noise 
when Yn = Vn for all n > 1. Some of the terms appearing in (ITOl ) are identical to the case where 
Yn = GXn + Vn for all n > 1 investigated for the proof of Theorem |3] Writing 

{Yn - YnfA-\Yn - Yn) = yjA'^K + 2V;^A~^GXn + X^G^A-^GX^ , 
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and using /x = viMF, •), (1331 ). (l34l) and some algebra, it is in fact sufficient to prove that 

- V XjC'^/\-^CXn / xTcT(CpCT + lrf)-iCx d^.(x, p) , (38) 

n=l 

- A- V„ / tr(C7pC7T + d/i(p) , (39) 

n=l 
1 ^ 

-5^yjA-iCX„-^0. (40) 

iV N—*oo 
n=l 

Now, these limits hold by observing that {Xn, Pn) = Z^^^°°^^ and by apply Theorem Ub) with a = 1 
for (HH), Theorem ffic) with a = 1 for ^ and Theorem ffic) with a = 2 for (|40l ). 
It remains to prove that ^HO:Noise > 0. From Equation ([T6l ). ^HO:Noise > / /(p)<i^(p) where /(p) = 
0.5 (logdet(C7pCT ^ _ CpC^{CpC^ + 1^)"^). This function satisfies /(p) > and /(p) = if 
and only if CpC^ = 0. Let Z € [0, Q(oo)] be a random variable with the invariant distribution jj., and 
assume that CZC"^ = with probability one. From Equation (ITSl) we have with probability one 

= CF/(Z)C^ = Ce-^^Ze-^^^'c^ - Ce'^^ZC^ (cZC^ + 1^)"^ CZe'^^^C^ + CQ(I)C^ 

= Ce-^^Ze-^^^C7^ + CQ{I)C^ = CQ{I)C^ 

Due to the controllability of {A,B) and the fact that t({0}) < 1, this is a contradiction. Therefore 
f{Z) > with probability one, hence ^HO:Noise > 0, which achieves the proof of Theorem |2l 

IV. Particular Cases, Discussion 

Different particular cases and limit situations will be considered in this section. We begin with the 
case where the sampling is regular, i.e., Ii is equal to a constant that we take equal to one without loss 
of generality. We then consider the case where the holding times are large with high probability, i.e., 
the sensors tend to be far apart. Finally, we consider the particular case where the SDE (dJ is a scalar 
equation. 

All proofs are deferred to Appendix 
Regular sampling 

When the sampling is regular, the model for (y„) under H1 (see Eqs. ([TT]) ) is a general model for 
stable Gaussian multidimensional ARMA processes corrupted with a Gaussian white noise. In this case 
we denote by $ = e'^"*^"^ = exp(-A) and by Q = Q{1) = exp{-uA)BB^ exp^-uA^) du the 
state transition matrix and the excitation covariance matrix respectively. 
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Proposition 4 (Regular sampling) In the setting of Theorem |2] assume that /i = 1 with probability 



one. Then —N log/3Ar(e 



N~*oo 



HO:Noise 



with 



iHO:Noise = - (log det {C PrC^ + Irf) - tr 



CPrC^ (CPrC^ + 1„ 



+tr 



where Pr is the unique sohition of the matrix equation 

P = $P$T - ^PC^ [CPC^ + IdY^ CP^^ + Q 
and where the q x q symmetric matrix S is the unique solution of the matrix linear equation 

H - ^{Iq - GC7)S(lg - GC7)T$T ^ ^c^T^T 

with G = PrC^ {CPrC^ + ldy\ 

Furthermore, when the roles o/ HO and H1 are exchanged (Theorem\3^, then 

Cm.signai = \ (tr (Cg(oo)CT) - logdet {CPrC^ + 1^)) . 



(41) 



(42) 



(43) 



(44) 



Equation (l42l l is the celebrated discrete algebraic Riccati equation. Its solution Pr is the asymptotic 
(steady state) error covariance matrix when the sampling is regular. The matrix G = PrC^ (CPrC^ + ^ 
is the Kalman filter steady state gain matrix [26, Chap. 4]. 

Large Holding Times 

We now study the behavior of the error exponents when the holding times are large with high 
probability. We shall say that a family (r^) of probability distributions on "escapes to infinity" 

as s ^ oo if 

\fK>0, Ts{[0,K]) .0. 

S—fOO 

In order to study the large holding time behavior of the error exponents, we index the distribution of 
the holding times by s and assume that escapes to infinity. A typical particular case that illustrates 
this situation is when we assume that the /„ are equal in distribution to si where I is some nonnegative 
random variable, and when we study the behavior of the error exponents for large values of s. 

Proposition 5 (Large holding times) Assume (ts) escapes to infinity. The following facts hold true: 
1 



(.HO: 



Noise 



s^oo 2 

1 



- (logdet {CQ{oo)G^ + U) - tr \cQ{oo)C^ {CQ{oo)C^ + 1^) ^ 



^HO.signai > ^ (tr [CQ{^)C^) - log det (CQ(cx))C7T + 1^)) . 



(45) 
(46) 
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Given an M'^-valued i.i.d. sequence such that Yi ~ A/'(0, 1^) under HO and Yi ~ A/'(0, CQ{oo)C'^+ 
Id) under HI , Stein's lemma says that the associated Type II error exponent coincides with the Kullback- 
Leibler divergence D (AA(0, 1^) || AA(0, CQ{oo)C^ + 1^)) = RHS dSll while if the roles of HO and H1 
are interchanged, the Type II error exponent is Z) (A/'(0, C(3(oo)C'^ + 1^) || A/'(0, 1^)) = RHS (l46l ). 
These results are expected: when escapes to infinity, two consecutive samples X{Tn) and X(T„+i) 
will tend to be decorrelated, and it will be realistic to approximate the process received under the 
signal hypothesis with an i.i.d. process which samples are distributed as A/^(0, CQ{oq)C'^ + 1^). 

The Scalar Case 

In the scalar case, the SDE ([T]) describes a so called Omstein-Uhlenbeck process 

dX{t) = -aX{t)dt + hdW{t), t>0 (47) 

where W{t) is a scalar Brownian motion and (a, b) are known real non zero constants. In our situation, 
a > and the initial value X{0) is independent from W{t) and follows the law AA(0, Q{oo)) where the 
variance Q{oo) is given by Q(oo) = b^/{2a). We observe {Yn ,Tn)i<n<N where (Yn) is a scalar process 
and we write the HO-Noise test as 

HO : y„ = K forn = 1, . . . , iV (48) 

HI : y„ = X(r„) + K forn = l,...,iV (49) 

where the observation noise process (Vn) is i.i.d. with Vi ~ J\f{0, 1). Solving Equation ( |47l ) between T„ 
and Tn+i we obtain that X„ = X{Tn) is given by 

Xn+i = e-''^"+'Xn + Un+i, nGN 

where C/„ ~ (O, Q„ = Q(oo)(l — e~^"^")). Statistically, the process (y„) is completely described 
under HI by the scalars a and Q{oo) and by the distribution r of Ii, and so are the error exponents. 
The parameter a controls the correlation strength between to samples of X{t) separated by a given time 
lag (the "memory" of the Ornstein-Uhlenbeck process). If Ii is integrable, we can assume = 1 and 
include the mean holding time into a. Turning to Q{oo), as X{t) ~ M{0,Q{oo)) for every t > 0, we 
notice from ^ that Q{oo) is simply equal to the Signal to Noise Ratio SNR = E[X^]/E[y„2]. 
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We begin by providing the error exponents expressions when the sampUng is regular. In the scalar 
case, it is easy to solve Equations (l42l ) and (1431 ) in the statement of Proposition |4] and to obtain the error 
exponents in closed forms: 

Corollary 1 (Corollary to Proposition |4j Regular sampling in the scalar case) In the scalar case, as- 
sume In = 1 with probability one. Put <I> = exp(— a). Then in the setting of Theorem^ the following 
holds true: 

- — log l5N{e) > Cm-Noise = - f log (1 + Pr) ( ^ -l]^ (50) 

where 

{SNR - 1)(1 - + ^/{SNR - 1)2(1 - $2)2 + iSNR{l - $2) 

2 • 

In the setting of Theorem \3} we have 

-1 log f3N{e) > ^HO.Signal = J (SNR - log (1 + Pr)) 

The proof of this corollary is omitted. We note that the result (l50l) coincides with the one stated in [7, 
Theorem 1]. 

We now get back to a general distribution for the holding times and consider the behavior of .^HOrSignai 
with respect to a and with respect to the Signal to Noise Ratio: 

Proposition 6 Assume the scalar case. In the setting ofTheorem\3\ the error exponent Cno:Signai decreases 
as a increases and SNR = Q{oo) is fixed, and linia^o Cno.signai = Q{oo)/2. Moreover, ^.Ho.signai increases 
as Q{oo) increases and a is fixed. 

One practical implication of this proposition is the following: from the stand point of the error exponent 
theory, when HO stands for the presence of a noisy 0-U signal, one has an interest in choosing close 
sensors if one wants to reduce the Type II error probability. This probabihty is reduced by exploiting the 
correlations between the 

In the setting of Theorem |2l the behavior of ^HO:Noise with respect to a has been analyzed in the regular 
sampling case only (Corollary [U in [7]. The authors of [7] proved that when SNR > dB, ^HO:Noise 
increases with a while when SNR < dB, ^HO:Noise admits a maximum with respect to a. By a numerical 
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estimation of ^HO:Noise (see below), we observe a similar behavior in the case of a Poisson sampling. 
However, a more formal characterization of the behavior of ^HO:Noise for a general distribution r seems 
to be difficult. 

V. Numerical Illustration 

Let {Xao,Poo) be a random element of x [0,Q(oo)] with distribution the invariant distribution v 
of the Markov process Pn). Then the error exponent provided by Theorem |2] can be also written 
1 



^HOiNoise ~ 2^ 



logdet (CPooC^ + U) + C (Xoo^T - p^j {CPooC^ + Id)' 
and the error exponent provided by Theorem |3] is 

CHO:Signal = \ (tr {CQ{^)C^) - E [log det (CPooC^ + Id)]) ■ 

By the stability of the Markov chain shown in Section |llll we estimate the error exponents 

by simulating the Kalman Equations (fT2l)-(fT3]) with i.i.d., Yi ~ AA(0, 1^), and by replacing the 
expectation operators in the equations above with empirical means taken on {Xn,Pn)n=i,...,N for 
large enough. 



Figures [T] and |2] describe the behavior of the error exponents in the scalar case. In Fig. [T] ^HO:Noise is 
plotted as a function of a for SNR = —3, and 3 dB. Poisson sampling as well as regular sampling is 
considered in this figure. We notice that ^HO:Noise increases for SNR = and 3 dB while it has a maximum 
with respect to a for SNR = —3 dB. As said in Section |IVl this behavior has been established in [7] 
in the case of a regular sampling. We also notice that Poisson sampling is worse than regular sampling 
for SNR = 3 dB and better than regular sampling for SNR = —3 dB from the viewpoint of the error 
exponent. 

In Fig. [2j the error exponent ^HO:Signai is plotted vs a also for SNR = —3, and 3 dB. The conclusions of 
Proposition [6] are illustrated. One interesting observation is that the error exponent with Poisson sampling 
is better than the error exponent with regular sampling for all considered SNR. 

Figures [3] and m concern respectively the behavior of ^HO:Noise and ^HO:Signai in the vector case. We consider 
following 2-dimensionaI process. 



dX(t) 



-1 









X{t) dt + 




1 1 




1 



dW{t) 



where W{t) is a scalar Brownian motion. We take C = I2 in (01). Both Poisson and regular models for the 
sampling are considered. In the Poisson sampling case, we assume that the I„ are equal in distribution to 
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Fig. 1. Scalar case: ^HOiNoise vs a for SNR = —3, and 3 dB 



sl where / is a Poisson random variable with mean one, and we plot the error exponents in terms of the 
mean holding time s. In the regular sampling case, s is simply the sensor spacing. The other parameter 
is the SNR given by 

_ nCXn + Vn\^] tr(CQ(oo)CT) 
E[|F„P] - d • 

A behavior comparable to the scalar case behavior is observed for both tests: In the case of the HO-Noise 

test, the error exponent increases with s at high SNR, while it has a maximum with respect to s at 

low SNR, and the Poisson sampling is worse than the regular sampling at high SNR. In the case of the 

HO-Signal test, we also observe that ^HOiSianai decreases in s, and Poisson sampling is better than the 

regular sampling for the three considered SNR from the standpoint of the error exponents. 

Appendix 

A. Technical lemmas 

In this section we provide some useful technical lemmas. 

Lemma 3 Assume that A is positive stable. Then there exists constants a > and K > Q such that 
||g-a;A|| £ K exp{—xa) for x > 0. 

Proof: Let a > be smaller than the real parts of all the eigenvalues of A and C be a rectangle 
in the complex half plane {z : ^{z) > a} whose interior contains all these eigenvalues. Applying 
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Fig. 2. Scalar case: ^HOiSignai vs a for SNR = —3, and 3 dB 



Theorem 6.2.28 of [20], we have e = e ^^{XI — A) ^ d\. Hence, we have 

||e-^'^|| < e-^'^y ||(A/-^)-i||dA. 
By continuity of A i-^ (A / — A)~^ on C, the previous integral is finite, which gives the result. ■ 

Lemma 4 Assume that the matrix A is positive stable and that the pair (A, B) is controllable. Then the 
matrix function Q{x) defined by ([71) is strictly increasing in the positive semidefinite ordering from to 
Q{oo) as X increases from to oo. 

Proof: Since (^4, B) is controllable, Q{x) > for any x > 0. Assume that x < y. We have 
Q{y) — Q{x) = exp{—uA)BB'^ exp{—uA'^)du = ex-p{—xA)Q{y — x) exp{—xA'^) > which proves 
the lemma. ■ 

B. A stability result on Markov chains 

Here we present our swiss knife result on Markov chains. We follow the approach in [27] for obtaining 
the geometric ergodicity of Markov chains using simple moment conditions, although we use a more 
direct proof inspired from [28]. For the a.s. convergence of the empirical mean, we will rely on the 
following standard result for martingales [29]: 

Lemma 5 Let (M„)„>o be a martingale sequence and Xn = Mn — Mn~i be its increments. If there 
exists p G [1, 2] such that ^^>]^ A;^pE[|X„|*'] < oo, then M„/n > 0. 
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Fig. 3. RLC Model: ^HOiNoise vs s for SNR = -3, and 3 dB 



We adopt the following setting for our generic Markov chain. Let {r],r]k, k > 1} he an i.i.d. sequence 
of random variables valued in E and let ^ be a closed subset of M.'^. Let Fy{x) be defined for all y e E 
and X ^ X with values in ^ and such that i-^ Fy{x) is a measurable X x E —>■ X function. This 

allows to define a Markov chain {Z^, A; > 0} by 

Zq = X ^ 

(51) 

^Zf = F,,(Z,-_i), k>l. 
This Markov chain is valued in Af and start at time with the value x. We denote by P the corresponding 
kernel defined on any bounded continuous function / : A' — M by 

=E(/(Zf)) =E(/oF^(x)), xeX. 

Observe that (ISTT ) implies, for all n > 1 

Z^ = F,„o...oF,,(x). 

We denote by | • | the Euclidean norm on M*^ and, for any p > 1 and / : ^ M, 

11,11 _ , \f{x)-f{x')\ 
"•^""^'^^ " .' Fx^ \x - x'\ (1 + \x\P-^ + \x'\P-') ' 
which is the Lipschitz norm for p = 1. We now state the main result of this appendix. 

Theorem 4 Define {Z^, k > 0} as in ASH . Assume that is a.s. continuous, and that, for some C > 0, 
a G (0, 1), p,r > 0, q > 1 and s > p. 
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Fig. 4. RLC Model: CnoiSignai vs s for SNR = ~3, and 3 dB 



(i) For all x, x' G and n > 1, 

E o . . . o F^^(x) - o . . . o Fr,,{x'W] < Ca"^ (1 + I^P + WD ■ 

( ii) For all x G Af ^ and n > 1, 

E[\Fr,^o...oFr„{x)n<C{l + \xn . (52) 
Then the following conclusions hold. 

(a) There exists a unique probability measure ji on X such that 

^ ~ ^ and ^ independent of r] ^ F^i^^) ^ ^ . (53) 

and this measure jj, has a finite s-th moment. 

(b) Let a E [1, s A {1 + s{q — l)/q}\ and f : X —^M. such that |l/||Lip„ < oo. Suppose in addition that 
s > h = pM {r(a — 1)}. Then, for all x (z X, 

1 " r 

k=l 

(c) Let {Un)n>i be a sequence of i.i.d. real-valued random variables such that E[|[/i|^+"^] < oo for some 
e > and, for all n > 1, Un is independent of iji, . . . , Then, under the same assumptions as in 
(b), if moreover s > a, then, for all x (z X, 

n ^ — ' n— >oo 
fc=l 
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where m = E[C/i]. 

Proof: Let us introduce the backward recurrence process starting at x defined by Yq = x and 

Yn = Frj^ o ■ ■ ■ o Fn^{x), n > 1 . 

Note that for any n, Yn = Z^, that is, the processes (Yn) and (Z!^) has the same marginal distributions. 
Moreover, using (i) and the Jensen Inequality, we have 



E 



1^+1 ~ 

n>0 



< ^C^/V/" {l + \x\P + E[\Fr,„{x)\P]) . 

n>0 

By (ii), since s > p, K [\Fri^{x)\P] < oo and thus Yln>o \^n+i — Yn\ < oo a.s. By completeness of the 
state space X, Yn converges in X a.s. We denote the limit by ^ and its probability distribution by /x. 
By a.s. continuity of F^, we have F^(Y"„) "—f' -F,j(^). On the other hand F^(y„) ~ Yn+i '—>' Hence 
/i satisfies (1531 ). that is, fi is an invariant distribution of the induced Markov chain. Moreover by (ii), 
we have sup„E[|y„|*] < oo which by Fatou's Lemma implies that E[|^|'^] < oo. Let us show that fi 
is the unique invariant distribution. By (i), for any x,y E X, Z^ — Zn > 0. Now draw x and y 

n—KX) 

according to two invariant distributions, respectively, so that (Z^)„>o and {Zn)n>o are two sequences 
with constant marginal distributions. Then necessary these two distributions are the same and thus fj, is 
the unique invariant distribution, which achieves the proof of (a). 

We now prove (b). First observe that / is continuous and /(x) = 0(|x|") as |x| —>■ oo. Hence by (a), 
since a < s, / is integrable with respect to fi. Also, by (ii), E[|/(Z^)|] < oo for all A; > 1 and x ^ X. 
We use the classical Poisson equation for decomposing the empirical mean of the Markov chain as 
the empirical mean of martingale increments plus a negligible remainder. Using that ||/||Lip < oo, the 
Holder inequality and (i), we have, for any x,y ^ X, 

^Y.\f(^k) - fizi)\ < c'/'^'^' (1 + wzn^-'a-,^ + 11^1^11:^7.^1)) (1 + i^r + \yn , 

k>l k>l 

where we used the notation || • \\p = (E[| • and q' = q/{q — 1). Since q'{a — 1) < s, we can apply 

the Jensen Inequality and (ii) to bound and We obtain, for some constant c > 



EY,\fiZl)-f{Zl)\<c{l + \x\' + \y\ 



k>l 

with h = pM {r{a — 1)}. Since we assumed s > b, using (a), the right-hand side of the previous display 
is integrable in y with respect to fi and we get 



E[/(ZJ)1-M/)I< / E^|/(Zf)-/(Zf)lM(d!/)<c'(l + |i|'). 



E 

k>l " k>l 
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Hence we may define the real-valued function 



f{x) = Y,{nf{zt)]-M} 



which is the solution of the Poisson equation f{x) — fi{f) = f{x) — Pf{x) and satisfies 



sup(l + \x\^) sup 1/(2;)| < oo . 

x&X k>l 



(54) 



Hence the decomposition 




ments. By the Jensen Inequality, we have E[|P/(Z^)|^/''] < E[\f{Z^^^)\'/^] and by §^ and (ii), 
supfc>i ]E[I/(^i^+i)|*/''] < oo. Since s/b > 1, by the Markov Inequality and Borel-Cantelli's lemma, this 
implies that Pf{Z^)/n "—^ 0. We also get that sup^,>i E[|Xfc|*/''] < oo and, by Lemma[5]X]fc=i ^k/n "—^ 
0. This proves (b). 

We conclude with the proof of (c). Using (b) we may replace Uk by Uk — m, that is, we assume 
m = without loss of generality. Then {Ukf{Z'k))k>i is a sequence of martingale increments. Let 
-u = (1 + e) A s/a > 1. We have supfe>i E[|[/fc/(Zf-)I"] = E[I[/iI"] supfc>i E[|/(Z^)|"] < oo by (ii) and 
the result follows from Lemma |5] ■ 

C. Proofs for Section |7H 

1) Proof of Proposition^ Given any deterministic nonnegative matrix p e [0, Q(oo)], the sequence 
of covariance matrices = Fi{Z^_^) where Fi is the second component of ([T5] ) with / = 1 is a 
deterministic sequence. From Lemma [J and Proposition [3]-Eq. (1271) . we have \\Z^ — Z^\\ < i^a'^ ||p — q|| 
for a G (0, 1) and K > 0. Hence, (see the classical proof of the Banach fixed point theorem), Z^ 
converges to a limit Pr defined as the unique solution in [0, Q(oo)] of the equation P = Fi{P) which is 
the discrete algebraic Riccati equation (l42l ). In the formalism of Proposition [T] this amounts to say that 
the invariant distribution coincides with 5p^. It remains to show that Equation (l42l ) has no solutions 
outside [0, Q{c<d)]. Indeed, assume that p is a solution of (l42l ). Consider the state equations (ITTI ) where 
it is assumed that X{0) --^ J\f {0,p). By the very nature of the Kalman filter, the covariance matrix Pk 
satisfies 



Pk<E [XkXj] 



pe 



+ Q{Tk) < e 



-nA. 



pe 
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As Pfe = p for any k, we have p < (5(oo) by taking the limit as A; — > oo. 

We now consider the invariant distribution v characterized by Proposition [2] This distribution writes 
V = vx ^Pr, and we shall show that ux = A/'(0, S) where S is the unique solution of Equation ( |43] ). 
To that end, we begin by showing that the steady state Kalman filter transition matrix B = ^{Iq — GC) 
with G = PrC^(CPrC^ + Irf)^^ has all its eigenvalues {Aj} in the open unit disk. Indeed, getting 
back to Equation ( [201 ) and passing to the limit, we have Pr = 0PrB^ + <^GG^^^ + Q. Assuming ti 
is an eigenvector of © with eigenvalue Aj, we obtain from this last equation that (1 — \Xi\'^)tJ P^ti = 
tJ^GG^^^ti + tjQti > due to Q = Q{1) > 0, hence |Aj| < 1. Consequently, the matrix equation 
dSll has a unique solution S = J2n=o®''^GG'^^^ [26> Chap. 4.2]. When Z*. = {Z^,Zk) G 
X [0, (3(oo)] follows the distribution u, we have (see ^) Z^. = QZf.__^ + ^GYk. Recall that 
Yfc ~ M{0, Id) and is independent with Z_i^_i. In these conditions, it is clear that ~ AA(0, S) when 
Z_i^_i ~ -A/^(0, S). Therefore, u = M{0, S) (E> 6pj^ is invariant, and by Proposition |2l it is the unique 
invariant distribution. Replacing u and fi with their values at the right hand sides of (fT6l ) and (ITtI) . we 
obtain (|4TI ) and (l44l ) respectively. Proposition |4] is proven. 

2j Proof of Proposition |5} We assume that the holding times /„ are equal in distribution to 
(distributed as r^) to point out the dependence on s. We also denote the invariant distribution of the 
Markov chain {Z^) defined in Section |lll] as /i^. We begin by proving that converges weakly to (5q(oo) 
as s ^ oo (notation fig =^ ^Q(oo))- By Lemma [3] we have E[|| exp(-PA)|p] < i^E[exp(-2aP)] = 
/ exp(— 2ax)rs(drE) with a > 0. Given a /sT > 0, we have / exp(— 2ax)Ts(dj;) = J^^ exp(— 2ax)Ts(dj;) + 
exp(— 2aa;)Ts(dx) < Ts{[0, K])+ex.-p{—2aK). As Ts escapes to infinity, E[||e~^°"^|p] — >s_»oo 0, which 
implies that e~^'^ — >s_^oo in probability. Moreover, we have 



hence Q{I^) Q{oo) in probability as s — > oo. Now, assume that the random variable Z € [0,(5(oo)] 
is distributed as fig- Recalling that F is the random iteration function defined as the second component 
of Equation O, we have \\Fis{Z) - Q{oo)\\ < if||e-^°^f + - Q(oo)||, hence Fi.{Z) Q{oo) 



compact set [0, (5(oo)], we have /log(l + p)d//s(p) -^s^oo f log{CQ{oo)G'^ + l^^), and (l46l) results 
from ([IT]). 

Now assume that Z — (^Z_, Z) G M''' x [0, Q[oo)] follows the invariant distribution i', and let {Z_^, Z\) — 




in probability as s ^ oo. As Fp{Z) ^ fig, fig =^ Sq{oo)- Due to the continuity of the logdet on the 
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where is defined by Equation (ITSl ). In particular, we have Z_i = Q{P,Z)Z_ + 



-PA 



G{Z)V. As E[||e- 



'PA\\2^ 



and Z < Q(oo), we have E[||e(P,Z)f] = E[||e-^°^(/ 



G{Z)C)f] ^™ and E[|e-^^^G(Z)y 
RHS of the Expression (fT6l ) of ^HO:Noise satisfies 



0, hence E[|Zi| 



0. The third term at the 



j x'^C'^ (CpC^ + Id) ^ Cx di/(x, p) < ||C7||2 j |x|2dz^(x, p) 



. 



As /is 



^Q(oo) 



, the second term at the RHS of ([T6]l converges to -tr[CQ(oo)C'^(C(5(oo)C'^ + 1^)"^], 



which terminates the proof of Proposition |5] 

3 ) Proof of Proposition ^ In the scalar case, the covariance update equation ([T3] ) writes 



P„+i = Ft^^(P„)=e- 



-2a/„ 



Q(oo) +Q(oo) 



(55) 



Pn + 1 

Given a sequence of holding times (/n)n>i and two positive numbers ai > 02, consider the two 
Markov chains ^ = Fj^{Z^ ^_^) for i = 1,2, both starting at the same value p = Q{oo). Let 
f{p) = p/{p + I) - Q{oo). As /((5(oo)) < and < exp(-2ai/i) < exp(-2a2/i), it is clear 
that Z^^ ^ > Z^^ ^. Assume that Z^^ > Z^^ ^, As f{p) is negative and increasing for p G 
[0,(5(oo)] and < exp(-2ai/fc) < exp(-2a2/A,.), we have Z^^ j^ = exp{-2ailk) f {Z^^ f^_i) +Q{oo) > 
exp{-2a2lk)f{Zl^k.i) + Q(oo) = Z^,. 

From Proposition [T] both the chains Z^^ ^ and Z^^ ^ have unique invariant distributions /ii and ^2 
respectively, and by repeating the arguments of the proof of Theorem [3l 
1 I' 

- J2 log (1 + Zi,k) / log (1 + P) d|^^ip) for ^ = 1, 2. 

fc=0 

As Z^^ ^ > Z^^ ^ for all k, by passing to the limit we have J log(l +p)d/ii(p) > f log(l +p)d/i2(p)- As 
?HO:Signai = 0.5 [Q{oo) — f log(l + p)dfi{p)) in the scalar case (see Expression ([TT]) ). this error exponent 
decreases with a. 

We now show that lima^o ^HOiSignai = Q{c<d) /2. Assume that Z G [0, Q{oo)] has the invariant distribution 
that we denote /x„. From Eq. we have E[Z] = K[Ff{Z)] = E[e-2"^1 ( E 
which results in 

+ (1 -E[e-2«^])Z' 



^-Q(oo) )+Q(oo) 



E 

As Z < Q{oo), we have E 
theorem, E[exp(— 2a/)] 



Q(oo)+l 



Z+1 



< E 



z+i 



Q(oo)(l-E[e-^'^^]) . 

< Q(oo)(l -E[e-2«^]). By the dominated convergence 
—5- as a ^ 0. It results that fia converges weakly to 



>a->o 1, therefore E[Z^] 
(5o as a ^ 0, therefore /log(l + p)dfj.aip) 0. Hence lima^o CHO:Signai = Q(oo)/2. 
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In order to show that ^HO:Signai increases with Q{oo), the argument is similar to the one used above to 
show that ^HO:Signai decreases as a increases. Proposition [6] is proven. 
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